Papers with probe accuracy
Information-Theoretic Probing with Minimum Description Length (2020.emnlp-main)
Copied to clipboard
| Challenge: | Despite widespread adoption of probes, differences in their accuracy fail to adequately reflect differences in representations. |
| Approach: | They propose an alternative to the standard probes, information-theoretic probing with minimum description length (MDL). |
| Outcome: | The proposed method agrees in results and is more informative and stable than the standard probes. |
Tracing Relational Knowledge Recall in Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Feature attribution analyses of the trained probes reveal correlations between probe accuracy and relation specificity, entity connectedness, and how distributed the signal on which the probe relies is across attention heads. |
| Approach: | They evaluate latent representations derived from attention heads and MLP contributions . they show correlations between probe accuracy and relation specificity . |
| Outcome: | The proposed representations are compared with the representations obtained from attention heads and MLPs. |